Disk Subsystem Load Balancing : Disk Striping vs . Conventional Data Placement

نویسندگان

  • Gregory R. Ganger
  • Bruce L. Worthington
  • Robert Y. Hou
  • Yale N. Patt
چکیده

The I/O subsystem is becoming a major bottleneck in an increasing number of computer systems. To provide improved I/O performance, as well as to accommodate growing storage requirements, disk subsystems are increasing in size. A major hurdle to obtaining the performance available from these large disk subsystems is load imbalance, or disk skew. Dynamic data placement, the conventional load balancing technique, is usually inadequate to deal with load imbalance because it is forced to accept atomic data sets with rapidly changing access patterns. We name this rapid uctuation oating load imbalance and distinguish it from the conventional view of load imbalance, referred to as xed load imbalance. Dynamic data placement also becomes increasingly di cult as the number of disks in the subsystem grows. Disk striping at a high granularity is suggested as a solution to oating load imbalance, the atomic data set problem and the complexity of balancing large disk subsystems. Disk striping uniformly spreads data sets across the disks in the subsystem and essentially randomizes the disk accessed by each request. This randomization e ectively handles both xed and oating load imbalance. Unlike dynamic data placement, disk striping does not become more complex as the number of disks increases. While a more optimal load balance may be possible for some very well understood and well-controlled environments, disk striping should provide signi cantly improved load balance with reduced complexity for many applications. This improvement will result in shorter response times and

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Disk Subsystem Load Balancing : Disk Striping vs . Conventional Data

The I/O subsystem is becoming a major bottleneck in an increasing number of computer systems. To provide improved I/O performance, as well as to accommodate growing storage requirements, disk subsystems are increasing in size. A major hurdle to obtaining the performance available from these large disk subsystems is load imbalance, or disk skew. Dynamic data placement, the conventional load bala...

متن کامل

Maximizing Throughput in Replicated Disk Striping of Variable Bit-Rate Streams

In a system offering on-demand real-time streaming of media files, data striping across an array of disks can improve load balancing, allowing higher disk utilization and increased system throughput. However, it can also cause complete service disruption in the case of a disk failure. Reliability can be improved by adding data redundancy and reserving extra disk bandwidth during normal operatio...

متن کامل

A New Approach to the Design of High Performance Multiple Disk Subsystems: Dynamic Load Balancing Schemes

The performance of storage subsystems has not followed the rapid improvements in processors technology, despite the increased capacity and density in storage medium. Here, we introduce a new model based on the idea of enhancing the I/O subsystem controller capabilities by dynamic load balancing on a storage subsystem of multiple disk drives. The request servicing is modified such that each requ...

متن کامل

File Placement in a Web Cache Server

Web cache servers (proxies) are increasingly popular for reducing Internet traac and improving response time. The disk subsystem appears to be a bottleneck in such servers. We present techniques for improving disk performance of Web proxies and evaluate them with simulation. The disk workload of proxies has a signiicant volume of new le writes. We show that directing writes to less loaded disks...

متن کامل

Ibm Research Report Dasd Dancing: a Disk Load Balancing Optimiza- Tion Scheme for Video-on-demand Computer Sys- Tems Dasd Dancing: a Disk Load Balancing Optimization Scheme for Video-on-demand Computer Systems

LIMITED DISTRIBUTION NOTICE This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and spe...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1993